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ABSntACT 


porotocol  over  a  channel 
widi  unknown,  time-vaiying  ciiaracteiistia  is  considered.  Ihe  transmitter,  with  two 
error-correcting  codes  at  its  disposal,  has  to  decide  vdnch  to  use  at  any  given  time.  Two 
algorithms  for  adapting  the  errar-correcting  code  to  the  channel  comfitions  are  presented; 
one  of  them  »<iime«  some  knowledge  of  tire  dstribution  of  errors  in  a  padcet,  while  the 
otter  no  such  assumption.  Both  algorithms  are  based  on  the  observation  that, 
when  a  packet’s  decoding  is  successful,  the  receiver  knows  the  number  of  errors  in  that 
padcet.  Both  algorithms  build  a  measure  for  link  quality  and  update  it  according  to  die 
decocfing  results.  Ite  first  algorithm  makes  use  of  the  number  ^  errors  in  the  padcet  to 
evaluate  the  probability  that  the  channel  is  in  a  given  state.  The  second  dgoritfam 
updates  its  measure  according  to  the  highes-rate  code  that  could  have  possibly  corrected 
tto  padcet.  When  this  measure  is  above  some  predefined  threshold,  the  ^t  code  is 
used;  otherwise  the  second  is  ea:qiloyed.  The  throughput  of  both  algorithms  is  ascer¬ 
tained  and  they  are  found  to  have  excellent  adaptivity,  approaching  that  of  a  transmitter 
with  perfect  kn^l^dge  of  thimnel  comfitions.  Extc^ons  to  more  than  two  cod9  ore 
discussed. 
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L  INTRODUCTION 


Automatic  repeat  request  (ARQ)  is  a  tecimique  for  ensuring  rdiable  data  transfer,  wfaicfa  is  used  in 
link-level  protocols  of  computer  communication  networks  [1].  Data  are  sent  over  tbs  link  by  packets 
(frames)  to  which  the  transmitter  adds  parity  bits  to  help  the  receiver  decide  ndiether  or  not  the  incoming 
data  contain  errors  or  not.  If  there  are  errors,  the  receiver  sends  the  transmitter  a  negative  ackno^edg- 
ment  that  prompts  retransmission.  Hybrid  ARQ  (HARO)  is  a  modification  of  this  schone  in  which  the 
data  are  encoded  by  an  error-correcting  cods  [2],  By  correcting  some  of  the  errors,  the  use  of  this  code 
results  in  fewer  retransmissions.  A  packet's  recqnion  is  unsuccessful  only  when  its  error  pattern  is  beyond 
the  correcting  capability  of  the  code,  in  which  case  we  say  that  the  decoding  has  failed. 

An  error-oorrecting  code  requires  many  more  redundant  bits  in  the  padcet  than  does  the  error¬ 
detecting  code,  so  that  there  are  fewer  data  bits  in  a  packet  of  a  given  size.  The  number  of  redundant  bits 
grows  with  the  error  correction  c^)ability.  When  dte  chaxmel  bit  error  rate  (BER)  is  high,  a  packet  under 
an  error-detecting  code  win  have  to  be  retransmitted  many  times  before  it  is  received  successfully.  The 
redundancy  of  the  error  correction  code  is  more  than  offset  by  the  reduced  number  of  retransmissions. 
However,  when  the  BER  is  low  few  packets  have  to  be  retransmitted,  even  with  an  error-detecting  code. 
In  this  case  the  full  power  of  the  error-correcting  code  is  not  utilized;  its  effect,  then,  is  just  a  reduction  in 
the  rate  at  which  data  are  transmitted  over  the  channel.  We  illustrate  this  trade-ofr  in  Figure  1,  which 
shows  the  performance  of  HARQ  for  a  channel  with  random  bit  errors.  The  or^nate  is  the  channel 
througi^t,  defined  as  the  expected  number  of  data  bits  successfully  received  per  packet,  normalized  to 
the  packet  length,  and  the  absdssa  is  the  probability  of  bit  error.  The  parameter  is  the  code  rate,  defined 
as  the  number  of  data  bits  divided  by  the  number  of  bits  in  the  padcet.  What  these  curves  mean  is  that,  if 
the  transmitter  has  several  codes  at  its  disposal  and  it  knows  the  channd  BER,  it  can  then  select  the  code 
that  yields  the  highest  throughput  under  the  (l^ARQ  protocol. 
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bi  many  instances,  however,  channel  error  ststisda  are  not  only  unknown  in  advance,  but  also  vary 
with  time.  In  such  cases,  wUcfa  are  common  in  ground  radio  links  that  are  subject  to  fluctuations  in  signal 
strength  and  to  interference,--  and  in  spread  spectrum,  muhiple-aocess  channels  in  winch  the  traffic  inten¬ 
sity  varies  with  time  -  it  is  not  desirable  to  determine  a  priori  the  code  rate  at  wfaidi  die  system  will 
operate.  Rather,  we  may  want  to  ada^  die  error  oonecdon  capability  according  to  channel  condidons. 
By  doing  this,  we  hope  to  ditain  a  performance  curve  that  follows  the  "envdope"  of  die  curves  in  Figure 
1.  Such  an  ARQ  protocol  that  changes  the  code  rate  according  to  channel  conditions  is  denoted  here  as  an 
adaptive  hybrid  ARQ  (AHARQ). 

Several  versions  of  AHARQ  techniques  can  be  found  in  the  literature.  The  most  ccnnmon  one  is 
based  on  encoding  the  data  with  an  error  correcting  code,  but  sending  first  only  the  data  bits,  protecting 
them  by  a  high-rate  error-detecdng  code  [3,4,5].  If  this  tran.smis.sion  is  unsuccessful,  the  error-carrecting 
bits  are  transmitted.  This  technique  avoids  wasting  channel  capacity  at  a  low  3£R  yet  has  the  power  of  an 
error-correcting  code  available  when  it  is  needed. 

Another  AHARQ  that  is  aimed  at  channels  with  high  BER  [6]  encodes  the  packet  with  an  error- 
correcting  code  and  sends  it  to  the  receiver.  If  the  decoding  is  unsuccessful,  the  padcet  is  retransmitted 
and  the  two  versions  of  the  packet  are  combined  at  the  receiver  (possibly  with  different  weights)  and 
effectively  obtair.  a  lower-rate  code.  The  receiver  stores  all  the  copies  of  the  received  packet  and  attempts 
to  decode  them  under  all  possible  combinations.  The  receiver  requests  a  retransmission  only  if  all  these 
decoding  efforts  fail. 

The  aforementioned  AHARQ  techniques  achieve  improved  channel  throughput  by  increasing  the 

complexity  of  the  decoding  mechanism  as  compared  with  nonadaptive  HARQ  ^^e  using  the  same  feed- 

badc,  namely  one  bit  ("ACK”,  T^AK")  for  each  transmitted  packet.  In  this  papa  we  select  the  ’’dual" 

approach  and  show  that  it  is  possible  to  adapt  to  varying  channel  conditions  by  using  the  same  Hwwvting 

procedures  as  in  "regular"  ARQ,  but  slightly  increasing  the  amount  of  feedback  information.  The 

increased  information  is  based  on  the  bit-error  pattern  in  the  padcet  that  is  Imown  to  the  receiver  when  the 

decoding  is  successful.  Of  course,  when  the  decoding  is  unsuccessful,  no  such  knowledge  exists.  The 
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AHARQ  algorithms  we  present  in  this  paper  utQize  this  infonnation  to  construct  and  tqidate  a  measure  for 
dumnai  quality.  Hie  better  of  two  codes  available  to  the  transmitter  is  sdected  from  this  measure  for  use 
in  the  next  transmission. 

This  p^ier  is  organized  as  follows:  Section  n  describes  the  basic  channel  modds  and  die  assumptions 
made  to  facilitate  performance  evaluation  of  the  algorithms.  The  first  model,  in  vdadi  the  channel  alter¬ 
nates  betweoi  states  of  known  error  distribution  widi  an  unknown  parameter,  is  discussed  in  Section  m, 
\diere  we  also  present  an  AHARQ  algorithm  that  tunes  die  code  rate  in  this  situation.  An  algorithm  for 
adapting  the  code  to  variadon  in  a  dmiwiri  that  alternate  between  states  of  unknown  error  statistics  can  be 
found  in  Section  IV.  In  both  cases,  the  resulting  channel  throughput  is  ascertained  by  means  of  a  proba¬ 
bilistic  model.  Section  V  contains  smne  extensions  of  diese  algorithms  to  allow  of  more  complicated  situa¬ 
tions  to  be  handled. 
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n.  MODELS  AND  GENERAL  CONSIDEIIATIONS 


Consider  the  following  situation:  a  transmitter  sends  to  a  receiver  padcets  of  n  tats  each.  The 
transmitter  has  K  codes  at  its  disposal,  denoted  as  €^,€2,  •  •  •  .c^.  A  code  Cf  is  characterized  by  a  triplet 
the  elements  of  winch  are  the  length  of  the  code-word,  the  code  rate  (ratio  of  the  number  of  data 
bits  in  a  padcet  to  n),  and  the  error-correcting  oqsaidity,  ndnch  is  the  maximum  number  of  bit  errors  that 
can  be  corrected  by  Cf.  We  use  the  convention  that  ri>rj  and  ti<tj  for  i<j.  Note  that  in  this  paper  all 
the  code  words  have  the  Mwie  length;  the  purpose  of  this  is  to  facilitate  presentation  and  analysis.  This 
assun^stion  can  be  relaxed  very  easQy. 

Assuming  random  error  distribution  in  the  packet,  we  note  that,  if  the  number  of  errors  e  in  a  given 
packet  is  smaller  than  r^, 

then  is  the  code  with  the  highest  rate  that  can  correct  the  packet.  That  b,  is  the  code  that  con¬ 
veys  the  largest  number  of  data  bits  in  a  packet  of  a  given  size;  hence  it  b  the  best  code  for  thb  error  pat¬ 
tern.  la  general,  when 

r(_i<«sr„  KinK  , 

the  code  Cj  conveys  the  mmimmti  number  of  data  bits  among  the  K  avaOable  codes.  When  e>tg,  none  of 
the  codes  can  decode  the  packet.  Gven  a  set  of  IT  codes  as  described  above,  the  collection  of  possible 
error  patterns  in  a  packet  can  be  partitioned  into  AT+l  regions  (l,2,..Jir-i-l)  so  that,  for  error  pattern 
isK,  code  b  the  best,  whereas,  for  i=K+l,  none  of  the  codes  b  useful. 

We  assume  that  the  dbtribution  of  errors  in  a  packet  b  governed  by  a  channel  parameter,  the  value 
of  which  we  denote  as  the  channel  state.  Condtioned  on  the  value  of  thb  parameta,  die  error  pattern  for 
each  packet  b  drawn  ind^iendently  of  other  packets.  When  the  channel  state  changes,  the  error  dbtribu¬ 
tion  also  changes.  Thus,  knowing  thb  dbtribution  and  the  parameter  value  provides  enough  information 
to  select  the  code.  Unfortunately,  since  full  knowledge  b  not  available  to  the  transmitter  and  it  thus  has 
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to  base  its  qxration  on  partial  loiowledge. 


We  consider  here  two  types  of  partial  knowiet^  the  transmitter  possesses:  (a)  the  transmitter  knows 
the  general  shape  of  the  distributian  of  the  number  of  errors  in  the  padcet  but  it  does  not  know  the  value 
of  one  of  its  parameters,  and  (b)  the  transmitter  does  imt  even  know  the  general  shs^  of  the  distribution. 
The  first  type  of  knowledge  can  be  encountered  in  charmeb  with  additive  white  Gaussian  noise  where  the 
errors  are  random  and  thus  the  number  of  errors  in  die  padcet  has  a  binomial  (fistribution,  a  fact  known  to 
the  transmitter.  The  dmnnel  state  is  rqjresented  by  the  BF.R,  p/i  while  in  that  state,  the  number  of 
enors  e  in  the  packet  is  given  by 

=  B(n,e,p,)  =  . 

The  BER  may  be  time  varying,  for  example,  as  a  result  of  onoff  jamming.  However,  the  rate  of  change 
is  relatively  slow  compared  with  packet  transmission  time. 

The  second  type  of  knowledge  may  be  exonplified  by  a  multiple>aocess  spread>spectrum  channel, 
where  the  prindpal  source  of  errors  is  interference  from  other  transmitted  packets.  It  has  been  shown 
that,  in  a  Lequency-hopping  system,  the  number  of  interfering  packets  A;  determines  the  bit  error  rate  in  a 
packet  [7].  Under  randmn  channel  access  protocol  the  number  of  interfering  packets  is  often  mcxleled  as  a 

"/ 

-a, 

random  variable,  indqiendent  from  packet  to  packet,  with  a  Poisson  distribution,  P(n;|aj)= — -e 

"r 

where  the  parameter  a,  is  called  the  trafflc  intensity  and,  m  this  case  represents  the  channel  state.  The 
traffic  intensity  is  usually  time-varying,  but  its  rate  of  change  is  slow  relative  to  packet  transmission  time. 
Thus,  for  a  given  a^,  the  BER  is  not  fixed  as  in  the  previous  example  but  is  a  random  variable  that  is 
independent,  identically  distributed  from  packet  to  packet.  However,  here  we  assume  that  the  transmitter 
does  not  even  know  the  general  shape  of  the  error  (fistribution. 
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We  assume  that  the  traosmitter  has  a  long  sequence  of  data  to  send  to  die  receiver.  When  die  algo¬ 
rithm  dictates  the  next  packet  to  be  transmitted  at  rate  r,  the  transmitter  uses  for  that  padcet  the  next  nr 
data  bits  from  that  sequence.  If  the  padcet’s  H<yndmg  is  successful,  die  transmitter  uses  the  immediately 
following  bits  for  the  next  packet.  If  the  fails,  however,  that  padcet  is  discarded  by  the  receiver 

and  the  transmitter  uses  for  the  next  padcet  the  first  nr  bits  from  the  sequence  it  had  before  transmitting 
the  padcet.  Here  r'  is  the  code  rate  to  be  used  in  the  next  transmission. 

Ihe  objective  of  the  AHARQ  algorithms  is  to  allow  the  transmitter  to  the  best  code  given  the  limited 
knowledge  it  has  about  the  channel  state.  The  performance  measure  we  apply  to  compare  the  codes  is  the 
average  throughput,  which  is  defined  as  the  expected  number  of  data  bits  conveyed  in  a  padcet  normalized 
to  the  packet  length. 

Under  the  aforanentioned  assumptions  of  conditional  i.i.d.  error  patterns  and  BERs,  a  reasonable 
iqpproach  is,  for  a  given  channel  state,  to  use  one  code  exdusively.  Consider  a  spedfic  error  pattern  distri¬ 
bution  P(t),  IsisJC+l,  where  F(i)  is  the  probability  that  the  number  of  errors  falls  into  the  aforanen- 
tioned  i-th  region.  If  code  is  used  exdusivdy  the  resulting  throu^iput  will  be 

S(*)  =  r*ip(0  ,  # 

k 

since  ^PO')  is  the  probability  that  decodes  the  padcet  successfuDy.  Ihe  code  that  achieves  the  highest 

1-1 

throughput,  5.,«,=mm{.y(0}.  is  the  best  one  to  use  for  the  specific  channd  state.  This  code  may  have  to 
be  changed  when  the  diannd  state  changes. 

Another  way  of  using  the  codes  is  to  sdect  a  code  at  random  according  to  a  distribution  Uj,  \<j<K. 
The  througlqiut  for  this  distributions  is 

s  =  .  # 

/-I  <-i 

K 

We  thus  want  to  choose  {uy},  ^uj-\,  such  that  5  is  maximum.  It  can  easily  be  shown  that  asitigning 

/-I 

=  1  to  the  that  maximizes  Eq.  (0),  and  uy-0  otherwise,  also  maximizes  5  m  Eq.  (0). 
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Thus,  the  problem  of  adqrting  the  code  rate  to  the  channel  conditions  can  be  coveniently  stated  as 
the  problem  of  determining  which  oiAeK  avaiMde  codes  achieves  the  highest  dnougl^xit  for  each  chan¬ 
nel  state.  Note  that  a  given  code  can  be  die  best  for  more  dsm  one  state  and  that,  in  fact,  we  may  face  a 
situation  in  whidh  aS  the  possible  channel  states  are  best  served  by  a  single  code  of  the  code  set  available 
to  the  transmitter.  If  the  state  of  the  channel  is  known  to  the  transmitter,  the  problon  is  trivial  because 
the  best  code  can  be  determined  from  Eq.  (0).  However,  the  channel  state  is  usually  not  known  to  the 
transmitter;  it  thus  has  to  make  a  decision  based  on  die  sequence  of  codes  it  used  in  the  past  and  the  feed- 
bacdc  it  obtained  from  the  receiver. 

We  turn  our  attention  now  to  the  receiver.  An  observation  that  is  fundamental  to  the  operation  of 
the  AHARQ  algorithms  presented  here  is  the  fact  that,  upon  the  correct  decnding  of  a  packet,  the  receiver 
can  ten  how  many  errors  the  received  padcet  has  containecL  There  is,  of  course,  the  possil^ty  of  decod¬ 
ing  error,  but  this  can  be  made  very  unlikely  a  smaQ  number  of  error-detecting  bits  (outer  code)  is 
added  to  the  data  pordon  of  the  packet. 


The  receiver  of  course  knows  the  set  of  available  codes  and  their  error-  correcting  capabilities.  Thus, 
from  the  enor  pattern  m  the  packet  the  receiver  can  also  teQ  which  of  t'le  codes  could  have  decxxled  the 
packet  correctly.  It  is  obvious  that,  when  the  receiver  fails  to  decode  a  packet,  it  gains  none  of  the  forego 
ing  information.  In  fact,  aU  the  reedver  then  knows  is  that  the  decoding  has  failed 

The  information  gained  by  the  receiver  can  be  fed  back  to  the  transmitter  by  very  few  Ints:  in  the 
first  case  in  which  the  number  of  errors  is  sent  back,  the  marimum  length  of  the  feedback  message  is  less 
than  or  ec]ual  to  log2rjr+l,  which  is  much  smaller  than  a.  For  example,  the  feedback  for  a 
(codeTSS, 0.5, 19)  code  can  be  represented  by  5  bits.  Li  the  second  case,  the  reedver  conveys  to  the 
transmitter  only  the  index  of  the  highest-rate  code  that  could  have  corrected  the  packet,  i.e.,  the  feedbadc 
message  is  log2(it-t'  1)  bits  long.  Note  that  the  receiver  does  not  have  to  send  the  raw  information  to  the 
transmitter;  it  can  carry  out  the  algorithm  to  detomine  the  next  code  that  should  be  used  and  notify  the 
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tnnsmittex  only  as  U')  the  index  of  that  code  via  a  \ogJC  bit  message.  For  the  rest  of  ^  paper  we  wiQ 
refer  to  the  iumitter  as  the  one  who  executes  the  algorithms;  however,  it  should  be  understood  that  the 
receiver  could  also  execute  it,  as  explained  above. 

Li  the  next  two  sections  we  present  and  analyze  the  performance  of  two  AHARQ  algorithms  for 
which  Jr~2.  These  are  bask  algorithms  in  the  sense  that  AHARQ  for  K>2  can  be  built  by  K- 1  operat* 
ing  bask  algorithms  in  parallel,  as  disnwsed  in  Section  V. 
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m.  CODE  SELECnON  FOR  CHANNEL  STATES  WITH  KNOWN  STATISTICS 

In  this  section  we  present  an  AHARQ  algorithm  that  assumes  that  the  transmitter  knows  the  general 
shape  of  the  packet  error  distribution  and  uses  the  number  of  errors  in  the  previous  packets  to  adapt  its 
code  rate  to  channel  conditioDS. 

Suppose  the  channel  alternates  between  two  states,  {Xi,k2},  each  of  which  has  a  completely  known 
error  distribution  and  known  parameters.  That  is,  the  transmitter  knows  the  conditianal  distribution  of 
number  of  errors  e  in  a  packet,  given  the  channel  state,  i’(e|Xf),  i€{l,2}.  Further  siippcse  that  the 
transmitter  has  at  its  disposal  two  error  correction  codes  {cy,c^  with  the  parameters  (n.r^.rj,  k=l,2. 
Recall  that  the  expected  normalized  number  of  bits  conveyed  by  a  packet  encoded  by  c^,  when  the  channel 
is  in  state  X„  is  given  by  5(ik,i)  =  r4F(«2sr4|Xj).  If  5(1,1)>5(2,1)  and  S(l,2)>5(2,2),  code  is  the  best 
under  both  states  and  the  transmitta  should  use  that  code  exdusivcly.  When  both  inequalities  are 
reversed,  only  code  C2  should  be  used.  However,  if  5(1,1)>5(2,1)  and  5(2,2)>5(1,2)  then  the 
transmitter  should  use  code  c,  whenever  the  dianiKl  is  in  state  X^ ,  (=1,2.  This  is  the  case  when  the 
AHARQ  algorithm  is  needed  most. 

Since  the  times  of  transitions  between  the  charniel  states  are  unknown  to  the  transmitter,  it  does  not 
know  for  sure  what  state  the  channel  is  in  at  any  given  time.  However,  it  can  rqjresent  its  level  of  belief 
that  the  channel  is  in  a  certain  state,  say  Xj,  by  a  number  q  (0<q<l),  which  will  be  referred  to  as  the 
subjective  probability.  The  subjective  probability  will  be  updated  according  to  the  deccxiing  rescilts  of  every 
packet  and  win  be  used  by  the  transmitter  to  select  the  code  for  the  next  packet.  The  larger  9  is,  the 
more  certain  the  transmitter  is  that  the  channel  state  is  X^  and  the  more  likely  it  is  to  use  code  Cj.  Let  us 
examine  this  notion  for  the  simple  case  of  myopic  policy,  in  which  the  transmitter  wishes  to  maximize 
throughput  for  the  next  transmissicm  only. 
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A.  Myopic  PoScy 


When  9  is  the  probability  that  the  rimnnel  is  in  state  at  a  given  instant,  and  code  is  used,  the 
expected  immediate  throughput  for  the  next  padcet  transmission  is  given  by 

=  rJ<,P,(r*|l)+(l-9)P,(r*|2)],  *€{1.2}  ,  # 

where 


PArkb^  “  # 

«-o 

is  the  probability  of  correct  under  code  and  channel  state  \j.  The  optimal  myopic  policy  is 

one  that  maTiTni7i>  the  immediate  througiqjut,  that  is,  it  uses  the  code  c^,  which  achieves 

E(S\i,q)  =  ta^{EiS\k,q)}  . 

Using  Eq.  (0),  we  find  that  this  policy  gives  rise  to  the  following  threshold  criterion  for  selecting  a  code:  if 

_ ^2^c(^2l2)-^i^c(^il2) _  _ 

^  ri[P,(ri|l)-P,(ril2)l-r2[P,(r2|l)-P,(r2|2)]  ’ 

then  code  should  be  selected;  otherwise  code  Ci- 


B.  Updating  4 

Usually  the  transmitter  is  interested  in  transmitting  a  sequence  of  padcets  and  in  maximizing  the 
average  throughput  for  the  whole  sequence.  To  this  end  it  should  update  the  value  of  q  after  every 
transmission  to  obtain  a  better  estimate  of  the  channel  state.  Let  q{k)  be  the  value  of  the  subjective  pro¬ 
bability  just  before  the  transmission  of  the  *-th  padtet.  Ihing  Bayes’  rule,  the  transmitter  oonputes  the 
conditional  probability  that  the  channel  is  in  state  Xj,  given  that  there  were  e  errors  in  the  previous  packet 
and  that  the  current  value  is  q(k).  This  conditional  probability  becomes  the  new  value.  That  is. 


9(*+l)  = 


,(*)P(e|l)+(l-9(*))P(e|2)  ' 

The  new  value  can  be  evaluated  by  Eq.  (0)  only  if  the  decoding  is  successful.  If  axle  C/  was  used  and  uie 


decoding  failed,  the  value  of  q(k-t- 1)  is  given  by: 


q(k+l)  = 


g(*)P(e>rJl)  _ 

9(*)F(e>r,|l)+(l-fl(*))P(e>f,l2) 


# 
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As  in  the  case  of  the  myopic  policy,  the  code  for  the  J;>th  packet,  c(k),  is  determined  by  q(k):  if  ^(ik) 
is  greater  than  or  equal  to  some  predetermined  threshdd,  the  transmitter  selects  c^,  otherwise  it  uses  code 
C2-  llte  threshold  may  be  different,  though,  from  the  one  m  Eq.  (0). 

Being  a  probability  measure,  0£4(ik)2l.  We  d  course  want  to  have  when  the  chaniiel  is  in 

state  and  q^O  otherwise,  and  to  have  that  probability  move  from  one  extreme  to  another  soon  after 
the  chatmel  switches  states.  First  it  should  be  noted  that,  if  9(l:)=0,l,  dien  q(k-f  1)=0,1  respectively, 
regardless  of  the  feedbadc.  This  means  diat,  if  die  transmitter  starts  with  an  overly  confidem  view  of  the 
channel,  or  ei'er  arrives  at  such  an  extreme  value,  it  never  discards  it.  Thus,  the  foregoing  extreme  values 
are  useless  for  our  algorithm  and  the  transmitter  should  never  use  them.  It  can  easily  be  shown  that 
^(ik+l)  does  not  achieve  the  above  f-gtiwiM  if  q(k)  is  not  at  these  values.  Therefore,  if  the  transmitter 
does  not  use  an  extreme  value  for  q(l),  then  q(k)  never  acquires  an  extreme  value.  In  the  following  dis- 
cussion,  we  thus  assume  that  0<q(k)<l  for  all  k. 

When  the  channel  is  in  state  X|,  the  probability  that  9(k+l)=q2  8*^™  9(^) 

4 

where  the  sum  is  over  all  values  of  e  that,  when  used  in  Eqs.  (0)  (0),  result  in  92* 

The  direction  in  vdiicfa  the  sequence  {qQc)}  moves  as  a  function  of  k  is  rqnesented  by  the  expected 
drift  which,  given  that  channel  is  in  state  X^,  is  defined  by 

E[q(,k+l)-q(k)\q(k),\,]  =  +  (l-9\*))i»(e|X2)  “ 

[«(*)/’(e>rlXy+a-9(*W(e>t|X2)  “  •  * 

where  t  relates  to  the  code  dictated  by  the  value  of  q(k)  and  die  threshold.  In  the  appendix  we  prove  that 
the  expected  drift,  given  that  the  channel  is  in  state  Xj,  is  positive  while  for  X2  it  is  n^ative.  That  is, 
{^(k})  moves  in  the  right  directions. 


is  given  by 

# 
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C.  Ouiind  Stita  with  UnfaMim  Panmcta 


It  very  rarely  happens  that  the  channel  alternates  exactly  between  two  states  in  aducfa  the  transmitter 
knows  the  parameter  of  their  error  distributian.  It  is  more  likely  that  the  channel  alternates  among  several 
states,  say  for  wtncfa  only  the  general  shqie  of  the  (fistribution  is  known  but  not  the  values  of 

the  parameter.  It  turns  out  that  the  aforementioned  algorithm  can  be  extended  to  diis  case  too.  The 
transmitter  selects  two  states,  say  and  X2,  ^frfncfa  have  the  same  error  distribution  as  the  a/s.  For  exam¬ 
ple,  if  the  a/s  have  binonial  distribution  with  unknown  parameters,  the  X/s  have  the  same  distribution  - 
each  with  a  specific  parameter  value.  The  parasmta  values  for  {Xj  are  selected  so  that  code  achieves 
the  higher  throu^iput  under  X^  and  C2  is  preferred  under  X2.  The  states  {X,}  are  called  die  dedaon  states. 
Given  the  outcome  of  the  decoding,  i.e.,  a  number  of  errors  in  the  packet  or  a  decoding  failure,  the  value 
of  ^(i+1)  is  stin  calculated  according  to  Eqs.  (0),  (0).  That  is,  the  decision  states  are  used  in  calculating 
However,  the  decoding  outcome  is  determined  by  the  true  channel  state,  say  a/,  widcb  means 
that  the  probability  of  moving  from  q(k)=qi  to  l)-92  ^  given  by 

* 

where  the  summation  is  taken  over  all  values  of  e  such  that  Eqs.  (0)  and  (0)  result  in  92* 

D.  Quantlxatiaaof  q 

The  metric  q  is  contimious  and  may  acquire  any  value  0<q<l.  However,  for  practical  reasons  it  is 
convenient  to  allow  q  to  take  only  a  finite  number  of  values  in  the  (0,1)  interval.  Quantizing  q  will  also 
facilitate  the  performance  evaluation  of  the  algorithm  over  a  tune-varying  channel.  As  it  turns  out,  quan¬ 
tizing  q  down  to  very  few  levels  does  not  degrade  the  performance  of  the  algorithm  if  the  quantization 
levels  are  chosen  properly. 
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A  quantization  for  9  is  defined  by  die  quantization  interval  boundaries, 

Q-dQ<di<d2<  •  •  ’  <d)^-i<d^=\,  and  by  M  discrete  values  of  q,  namely,  91,921— >9a/>  wbere 
di-\<qi<di.  Now,  if  there  are  e  errors  in  the  padcet  and  q(Jt)=qi,  die  state  changes  to  9(Jt+l)=9y  such 
that 


.  ^  gin*ixi) 

if  €St,  and  if  e>t  the  new  value  is  qj  for  i^iucfa 


dj-i< 


_ 9<^(<»|Xi) _ 

9,P(e>r|Xi)+(l-9<)y*(e>rlX2)  ^ 


# 


# 


Note  diat,  if  some  quantization  intervals  are  too  large,  it  may  happen  that  for  a  given  9^  all  values  of  e 
lead  to  9y=9j  in  Eqs.  (0)  and  (0).  If  this  is  allowed  to  happen,  the  algorithm  wiD  never  leave  the  value  9^ 
and  will  thus  lose  its  adaptivity.  Therefore,  the  quantization  intervals  should  be  small  enough  to  ensure 
high  probability  for  leaving  each  of  thenL 


E.  Parfamumce  Evabudan 

We  use  the  following  model  to  evaluate  the  throughput  achieved  by  the  aforementioned  algorithm; 
time  is  slotted  into  equally  long  slots,  each  of  which  fits  an  n  bit  packet.  The  transmitter  has  two  codes 
and  C2,  where  C/  =  (n,r^,r,).  The  transmitter  has  a  long  data  sequence  to  send  which  it  does  so  by  taking 
enou^  data  bits  in  each  slot  to  fit  into  an  n  bit  padcet,  which  is  encoded  by  one  of  the  above  codes.  The 
channel  can  be  m  one  of  N  states,  where  each  state  has  a  known  error  distribution,  possibly 

with  an  unknown  parameter.  The  channel  dianges  states  at  the  slot  boundaries  and  the  channel  state  trath 
sidons  are  done  according  to  a  Markov  chain  with  tranudon  probabilides  Pc(ay|a,),  which  are  not  neces¬ 
sarily  known  to  the  transmitter. 
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FoUawisg  each  transmissioii,  die  reoetver  sends  hack  to  the  transmitter  die  number  of  enors  if  the 
packet  decodtng  was  successful  or  a  NAK  if  it  was  not.  Tlie  feedback  message  is  sent  instantly  on  an 
error-free  channel. 


Ihe  transmitter  keq»  the  link  quality  measure  q  that  can  acquire  one  c/l  til  M  possible  values. 
Based  on  feedbadc  informadon,  the  value  of  9  is  iqxiated  acoordhig  to  Eqs.  (0)  and  (0);  two  states  and 
X2  with  known  statistics  are  used  in  diese  equadons.  These  two  states  are  used  for  decision  purposes,  as 
above,  and  they  are  chosen  to  make  the  code  Ci  achieve  the  hi^ier  tfarou^qiut  under  Xj  and  C2 
do  so  under  X2. 

Whenever  the  value  of  q  is  greater  than  or  ecjuals  a  predetermined  threshold  q^,,  the  transmitter  uses 
code  C2;  otherwise  it  uses  code  c^. 


Ikider  the  above  assumpdons  the  dynamics  of  the  algoriduns  can  be  described  as  a  Markov  chain 
{(q(il;),a(k)),  k=l,2,...},  vdiere  q(k)  and  a(k)  arc  the  value  cd  q  and  the  channel  state,  respeedvely,  just 
before  the  k-th  slot.  The  chain  has  MN  states  and  the  transidon  probabilides  are  given  by 


P{q(k-H),a(*-H)lq(k),o(k)} 


‘fF(e|a(ik))8(e,q(*),q(k-H)) 

(-0 


/’(«>»,(*)  |o(*)){(^  F9(k),9(k+ 1))] 


# 


where  8(tf,q(k),q(k-f-l))sl  if  using  the  values  of  e  and  q(k)  in  Eq.  (0)  yields  q(k+l),  and  0  otherwise. 
Similarly,  {(e,q(k),q(*+l))»l,0  if  using  e  and  q(k)  in  Eq.  (0)  yields  q(k+l)  or  not,  respeedvely.  Also, 
',(4)='!  r,(t)*r2  otherwise. 


When  the  ({uandzadon  levels  are  chosen  carehiDy  as  eiplained  above,  none  of  the  states  is  an 
absorbing  state  and  the  dmm  is  thus  ergoeSe  with  a  steady-state  probability  vector  «  given  by 

w  »  wP  # 

where  P  is  the  state  transidoo  matrix. 
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The  throughput  5  is  given  by 

S  =  2[2  .  * 

<-i  y»i  ;-ifc 

vdiere  Vjj  is  the  steady-state  probability  that  the  channd  is  in  state  {qj,a.^. 

F.  Dhmwfawi  of  Numertgl  Reanlta 

The  througl^wt  of  the  algorithm  was  ascertained  numerically  and  the  results  are  shown  in  Figures 
(2)-(4).  L)  aD  these  figures  the  transmitter  has  two  codes,  (255,1,0)  and  (255,0.5,19).  The  errors  in  a 
padcet  are  random  and  the  conditional  distribution  of  the  number  of  packets  is  binomial  widi  parameter 
(^R)  a.)  which  varies  with  time.  In  computing  q,  die  transmitter  uses  two  decision  states  widi  the  above 
error  distribution  and  with  parameters  X^=0.001  and  Xj^^O.Ol.  The  dumnel  ahemates  between  two  states 
and  a^,  vdudi  are  not  necessarily  the  same  as  the  decision  states. 

To  appreciate  how  well  the  algorithm  works,  we  compare  the  througlq;>ut  it  adneves  to  that  achieved 
by  three  other  siii^)le  sdiemes: 

(1)  Transmitter  uses  code  only,  regardless  of  feedback. 

(2)  Transmitter  uses  code  Cj  only,  regardless  of  feedback. 

(3)  Transmitter  knows  the  exact  channel  state  at  aD  times  and  thus  always  matches  the  best  code  for  diat 
state.  This  scheme,  called  the  ideal  observer,  dearly  sets  an  upper  bound  on  the  througiqjut  achievable  by 
a  transmitter  with  limited  information. 

Figure  2  dqricts  the  througl^wt  achieved  by  the  algorithm  as  a  function  of  the  threshold  level.  The 
chaxmel  transitions  are  symmetric,  which  means  that  the  channel’s  average  stay  in  a  state  before  "miring  a 
transition  is  equal  for  both  states.  The  abscissa  in  Figures  2(a)-(c)  is  the  sojourn  time  -  the  average  stay  in 
a  state  expressed  in  padcet  transirission  lengda.  Four  values  of  sojourn  time  are  depicted  in  these  figures: 
100,  10,3.  In  Figure  2(a)  the  channd  states  are  oj-O.OOOS  and  a2=*0.03.  hi  this  case  we  see  that  the 
algorithm’s  throughput  is  better  than  that  achieved  by  other  of  the  codes  when  it  is  used  exdusively  even 
for  very  smdl  sojourn  times.  VJbca  the  channd  stays  at  the  state  longer,  the  througlqput  qiproaches  the 
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upper  txnuid  addeved  by  the  ideal  observer.  Note  dud  the  threshold  level  has  little  effect  cm  die 
throughput,  so  that  its  selection  is  not  a  critical  design  issue. 

In  Figure  2(b)  the  states  are  ai=0.004  and  02-0.06;  in  both  of  diem  code  C2  is  preferred.  In  this 
case  die  threshold  level  and  the  sojourn  time  have  only  sli^  effect  on  the  diroughput.  hi  Figure  2(c)  the 
sqiaration  between  the  channel  states  is  smaller  and  here,  at  short  sojourn  times,  the  direshold  determines 
vdiether  the  algorithm  is  better  than  or  worse.  When  the  sojourn  time  is  iwwSimi  to  large,  the 
algorithm’s  throu^lqiut  is  larger  than  diat  of  and  i^iproacfaes  the  ideal  curve. 

Figure  3  dqiicts  the  effect  of  the  sojourn  time  on  the  throughput  in  a  channel  with  symmetric  transi* 
dons.  Note  that  the  algorithm  approadies  the  i^al  curve  for  relatively  short  sojourn  times.  Hgure4dq;> 
icts  the  performanoe  of  die  algorithm  for  a  channel  with  asymmetric  transitions.  In  this  case  the  channel 
spends  an  average  of  20  padcet  transmission  times  in  state  and  a  different  time  in  02.  The  abscissa  of 
Figure  4  is  the  average  time  spent  in  state  02.  Note  diat  the  algorithm  follows  the  ideal  curve  quite 
dosely. 
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IV.  AN  ALGORITHM  FOR  A  CHANNEL  WITH  IJNKNOWN  ERROR  STATISTICS 


The  algorithm  in  the  previous  section  made  direct  use  of  the  number  of  errors  in  the  packet,  v^ch 
was  possible  because  the  general  characteristics  of  the  error  statistics  were  assumed  to  be  known.  This 
knowledge  may  not  always  be  available,  since  very  (tften  there  are  many  diverse  factors  that  influence  the 
error  pattern  and  their  overall  effect  cannot  be  quantified.  In  this  section  we  consider  a  channel  with  unk¬ 
nown  distribution  of  the  error  patterns. 

As  in  the  previous  case,  here  too,  when  a  padcet  is  sent  by  code  Cf  and  it  is  successfully  decoded,  the 
number  of  errors  in  that  padcet  is  known  to  the  receiver.  Also  known  to  it  is  the  set  of  codes  available  to 
the  transmitter  and  their  characteristics  {(R,r/,r()}.  Tims,  for  each  error  pattern  observed  in  a  decoded 
padcet,  the  receiver  can  tell  which  of  the  other  available  codes  could  have  been  used  to  decode  that  padcet 
successfully.  It  is  reasonable  to  assume  that,  if  the  code  of  rate  could  decode  the  padcet  all  other  codes 
with  rates  ry<r,  could  have  done  so  too.  Thus,  the  receiver  checks  only  those  codes  with  rates  higher  than 
the  code  that  was  actually  used.  The  receiver  sends  to  the  transmitter  on  the  feedback  channel  the  index 
of  the  highest-rate  code  that  could  have  decoded  that  packet  successfully. 

As  before,  when  the  packet’s  decoding  is  unsuccessful,  the  receiver  srads  only  a  NAK  to  the 
transmitter.  In  both  cases,  the  decoding’s  success  information  is  used  by  the  transmitter  to  update  its 
knowledge  about  the  channel  and  to  determine  the  code  for  the  next  transmission. 

The  basic  algorithm  is  the  one  that  decides  between  two  codes,  say,  and  C2,  where,  say,  r^>r2, 
(ri<r2).  hi  this  case,  the  set  of  all  the  possible  oror  patterns  is  partitioned  into  three  groups:  (1)  those 
that  can  be  corrected  by  both  codes,  (2)  those  that  can  be  corrected  only  by  C2,  and  (3)  error  patterns  that 
can  be  corrected  by  neither  of  these  codes.  In  the  following  discussian  we  assume  that,  while  time  the 
channel  is  in  a  given  state,  say  aj,  the  error  patterns  are  independent  from  padcet  to  padcet.  The  proba¬ 
bility  that  an  error  pattern  falls  into  group  i,  when  given  the  channel  is  in  state  ay  L  denoted  by  Pj(ji), 


-18- 


i  =  1,2,3. 


We  propose  that  the  transmitter  keqis  a  metric,  denoted  by  x,  that  measures  how  weD  one  code  per* 
forms  as  oonqiared  with  the  other  code.  The  transmitter  bases  its  code  selection  on  this  metric  ^)ecifi* 
caUy,  «4ien  the  transmitter  uses  code  and  the  error  pattern  faDs  into  group  1,  this  meam  that  the 
transmitter  could  have  achieved  througlqatt  greater  by  r^—r^,  had  it  used  code  instead.  Thus,  in  this 
case  X  is  increased  by  the  amount  ri-r2.  If  the  error  patterns  faQs  into  group  2,  die  itiwmiTig  is  that,  if 
the  transmitter  had  used  for  this  padcet,  it  would  have  lost  the  whole  packet  whereas  imHw  it 
obtained  the  througlqput  of  r2.  The  transmitter,  therefore,  subtracts  r2  from  the  value  of  x  in  this  case.  If 
the  error  pattern  falls  into  group  3,  then  x  remained  unchanged  since  none  of  the  codes  can  convey  any 
data. 


Gmsider  now  the  case  in  which  the  transmitter  uses  code  c^.  If  the  error  pattern  falls  into  groiqi  1, 
here  too,  x  is  increased  by  rj'-r2.  However,  the  receiver  cannot  distinguish  between  error  patterns  2  and 
3  since  in  both  cases  the  decoding  is  unsuccessful  under  c^.  Thus,  when  the  transmitter  is  operating  with 
Cj  the  X  can  be  either  decreased  by  r2  or  remain  unchanged  for  both  error  pattern  groups.  In  the  follow¬ 
ing  discussion  we  assume  that  the  former  possibility  is  used. 

We  denote  by  x(i<:)  the  value  of  x  just  before  the  ii-th  padcet  transmission  and,  as  before,  c{k)  is  the 
code  used  for  the  k-th  packet.  The  transmitter  starts  with  x(l)=0  and  uses  C2  for  the  first  pai^.  It 
i^xlates  X  according  to  the  feedback  information  as  described  above  and  uses  the  value  of  x(il:)  to  deter¬ 
mine  c(il;+l)  according  to  the  following  rule: 

x(i:)sO  then  c(t+l)=C2*  c(Jt+l)=Ci 

Suppose  now  that  the  channel  is  in  a  given  state  ay,  with  error  region  distribution 
{Py(l),/*y(2),i*y(3)}.  Rccall  that  since  the  padcet  error  patterns  are  i.i.d.,  one  code  should  be  used 
exdusively  while  the  channd  is  in  this  state.  II  code  is  used  in  state  ay,  the  througl^t  will  be 
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For  the  distribution,  {/y(0}t  code  is  better  than  £3 

riP(l)>r2[F(l)+F(2)l  ,  # 

and  code  rj  is  betta  otherwise.  Snoe  x(k)  determines  c(k)  according  to  the  above  rule,  we  want  {x(JI:)}  to 

be  positive  i^iien  {P/i)}  is  such  that  inequality  Eq.  (0)  holds  and  be  negative  when  it  is  reversed. 

The  expected  drift  of  for  that  distribution  is  given  by 

£[x(t+l)-x(*)|x(*)s0,Oy]  =  h-rj/»y(l)-r2/»y(2)  # 

and 

£[x(it+l)-x(*)lx(*)>0,Oyl  =  [ri-r2]i»y(l)-r2[i»y(2)+Py(3)]  .  # 

Note  that  for  x(k)s0  the  drift  is  positive  wiwn  the  inequality  Eq.  (0)  is  true  and  negative  when  it  is 
false.  That  is,  when  cj  is  used  (x(ik)^O),  the  feedbadc  provides  the  transmitter  with  enough  information 
so  that  the  sequence  {x(A:)}  increases  or  decreases  acoordipg  to  the  conditions  in  Eq.  (0).  Thus,  under 
{£y(t)}  for  vritich  Eq.  (0)  is  satisfied,  if  x(ib)s:0,  the  sequence  {x(ik)}  win  move  up  and  eventuaDy  cross  the 
threshold  so  that  the  correct  code,  C|  win  be  used.  When  x(ifc)si0  and  the  inequality  sign  in  Eq.  (0)  is 
reversed,  {x(ib)}  wDl  tend  to  remam  negative,  ther^  causing  C2  to  be  used,  which  is  the  better  code  for 
this  case. 

The  situation  is  slightly  different  for  positive  values  of  x(k)  in  which  is  used.  For  this  code,  the 
error  pattern  groups  2  and  3  are  indistinguishable  because  cannot  correct  any  of  them.  This  causes  the 
drift  when  x(ik)>0  to  be  positive  or  negative  under  slightly  different  conditions  from  those  given  in 
Eq.  (0).  Although  in  most  cases  these  different  conditions  do  not  degrade  the  algorithm’s  performance, 
there  are  some  disiiibutions  {Py(0}  for  which  such  degradation  may  occur.  This  luq^jens  when  the  channel 
is  in  state  Oy  for  which  the  following  double  inequality  holds: 

r2[P(l)+/»(2)]<rii»(l)<r2  .  # 

For  this  distribution,  Eq.  (0)  holds,  implying  that  should  be  used.  Indeed,  the  drift  for  x(k)s0  is  posi¬ 
tive,  which  makes  the  algorithm  less  likely  to  use  C2.  However,  when  x(k)>0,  Eq.  (0)  yields  negative 
drift,  because  of  the  right  inequality  in  Eq.  (0),  vdiich  tends  to  push  {x(k)}  down.  The  total  effect  is  that 
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{j;(il:)}  oscillates  around  the  zero  level,  thereby  aooqjting  n^ative  values  more  oftoi  than  if  it  had  stayed  at 
a  level  far  away  from  the  threshold.  Note  that  adten  x(<:)£0,  code  C2  is  used  with  the  attendant  loss  of 
througl^t,  since  is  better  for  this  distribution. 

The  region  of  /’(I)  and  P(2)  for  which  Eq.  (0)  holds  is  dqxcted  in  Egure  5.  For  all  other  possible 
combinations  {F;(0}>  the  drift  has  the  proper  sign  for  both  negative  and  positive  values  of  x(jt),  thus  mak¬ 
ing  {x(k)}  move  in  the  right  direcdon  according  to  Eq.  (0). 

When  the  channel  state  changes  so  that  the  inequality  Eq.  (0)  is  reversed,  the  code  should  also 
change  to  provide  the  highest  possible  througlqxit.  That  is,  {x(k)}  should  change  sign  as  fast  as  possible. 
If  {x(k)}  is  not  bounded  from  above  and  below,  when  the  channel  conditions  persist  for  a  long  time  {z(Jt)} 
win  grow  in  either  the  positive  or  negative  direction.  A  large  value  of  {x(k)}  results  in  a  long  time  to 
reach  the  threshold  and  to  switch  codes  after  channel  state  changes,  implying  loss  of  throughput. 

To  expedite  threshold  crossing  upon  state  change  we  set  upper  and  lower  bounds  B„>0  and  B;<0, 
respectively  whidi  we  do  not  aOow  {x(il;)}  to  cross.  Thus,  when  the  error  pattern  is  in  group  1 

x(k+l)  =  min(i?„x(*)+ri-r2)  ,  # 

and  when  the  pattern  is  in  groiq)  2  and  x(k)£0,  or  in  groups  2  or  3  and  x(ii)>0: 

x(*+l)  =  max(S„x(/fc)-r2)  # 

The  boundaries,  denote  as  Bi  should  be  low  enmigh  to  aDow  for  quick  code  change  when  it  is  needed, 
as  wen  as  high  enough  to  keep  smaD  the  probal^ty  of  level  crossing  as  a  result  of  statistical  fluctuations. 

When  {/*(()}  ia  such  that  for  x(JI;)>0  the  drift  is  negative  and  for  x(jl:)£0  it  is  positive  (Eqs.  (0), 
(0)),  {x(k)}  fluctuates  around  the  zero  level  regardless  of  the  level  of  Since  at  this  region  should  be 
used,  we  increase  the  time  {x(ilr)}  is  positive  by  oocasionaDy  setting  x(k)  to  B^  upon  zero  crossing  from 
below.  We  thus  modify  the  algorithm  as  foDows:  whenever  an  error  pattern  of  type  1  occurs  such  that  the 
tqjward  step  (of  size  r2-r^)  of  x(k)  causes  it  to  cross  the  zero  level,  x(k)  makes  this  normal  step  with  pro¬ 
bability  1  and  with  probability  x(k)  is  set  to  the  value  of  Eq.  (0)  now  applies  only  in  the  case 


-21- 


of  x(i)>0  or  x(it)s-(rj-r2).  However  wdicn  -(ri— r2)<x(*)s:0,  the  new  value  of  x  upon  error  pattern 
of  type  1  is  given  by: 


x(*+l)  = 


j'x(t)+ri-r2 


w.p. 


# 


A.  Perfonnance  Evafaiatloa 

Tbe  model  we  use  to  evaluate  the  performance  of  this  algorithm  is  Mmilar  to  that  ci  the  previous 
section.  Channel  time  is  composed  of  fixed-size  slots  equal  in  length  to  the  packet  size.  The  feedbadc  is 
sent  to  the  transmitter  instantly  on  an  error-  free  charmel.  The  ducmel  alternates  among  N  possible 

states,  (a^ . Oy)  where  each  state  aj,  is  characterized  by  a  distribution  {Py(i)}  of  the 

error  pattern  groups.  The  channel  may  switch  states  only  at  slot  boundaries  and  doing  according  to  a  Mar¬ 
kov  chain  with  transition  matrix  i*(a(ik+l)  =  ay|a(ik)=aj) 


Since  r^,  rj  are  rationals,  we  can  represent  fire  two  nonzero  steps  of  x,  namely,  and  r2  by 
integers.  As  before,  and  JBj  are  the  lower  and  upper  bounds,  respectively  which  means  that  the  channel 
metric  X  can  take  values.  Thus,  the  process  {(a(k),x(k)),  ksl,2,...}u  an  ergodic  Markov 

chain.  The  chain's  transition  probabilities  are  given  by 

P(a(*+l)=Oy,x(k+l)=x,lo(*)=a„x(t)=x,)  =  P^(j\i)P,(j\n)  ,  # 

whm 


P,(j\n)  - 


PXl)q^  if7=fi,  and-(ri-r2)<ns0 

if)=«+ri-r2  and  -(ri-r.J<nsO 
Pj(l)  if  and r2)  or  n>0 

P,(2)  if  j=max(Bi,n-r^,  n<0 
P((2)+Pj(3)  if  r2,  n>0 
P,(3)  ify'^a,  nsO 


# 


For  some  ccmbinatiaDS  ct  r^,  r2,  x(k)  never  aoquim  some  of  the  values  between  and  A,  we  consider  only  the  values  x(k) 
actually  takes. 


.22- 


If  we  denote  by  irOVi)  its  steady  state  prc^xibility  diat  the  cfaam  is  in  state  the  througlqnit  of 


the  algorithms  can  be  written  as: 


.V 

<-i 


2  ir(i.n)r2[/»(l)+P(2)]  +  2 


# 


B.  Dbcnaafam  of  Nmncrlcal  Reanlti 

The  performance  of  the  algorithm  is  dqxcted  in  Figures  6-8.  The  two  codes  used  in  these  curves  are 
Cl  »  (235,1.0)  and  cj  =  (235,0.5,19).  Figure  6  slmws  the  throughput  obtained  by  the  algorithm  vdien  the 
channel  alternates  between  two  states  with  equal  expected  sojourn  time  in  both  states  (symmetric  transi¬ 
tions).  We  see  that,  for  very  short  sojourn  times,  dse  throughput  is  better  than  that  achieved  by  using  a 
single  code  only,  that  is,  using  no  information.  As  the  sojourn  time  increases,  the  throughput  gets  doser 
to  the  one  achieved  by  an  ideal  observer. 

Figure  7  shows  the  effect  of  9,.  on  the  throughput.  In  Hgures  7(a)  and  7(b)  the  channel  stays  in  one 
state  only.  However,  the  distribution  {P(<)}  of  this  state  is  such  that  the  drift  has  positive  sign  for  xsO 
and  negative  otherwise,  a  situation  that  causes  {x(il)}  to  oscillate  around  the  zero  level  and  thereby  to 
lower  throughput.  For  this  distribution  code  is  better  and  we  can  see  that,  as  the  probability  of  jumping 
to  upon  zero  aossing  from  below  increases,  so  does  the  throughput.  Thus,  one  should  operate  in  such 
situation  with  a  large  value  of  .  One  may  wonder  whether  increasing  win  have  negative  effect  when 
{/*(i)}  is  not  in  the  region  depicted  by  Figure  5.  Figure  7(c)  shows  that,  for  one  such  distribution,  q^  has 
very  little  effect. 

Figure  8  shows  the  improvement  in  throughput  that  can  be  achieved  by  increasing  B/  and  B..  We 
see  that  the  improvement  is  rather  small.  Figure  9  compares  the  performance  of  the  algorithms  described 
in  the  current  and  the  (nevious  sections.  To  compare  them  on  an  equal  basis  we  assumed  the  number  of 
erron  in  the  packet  to  be  binomiaDy  distributed  and  the  two  BERs  to  be  0.008  and  0.02.  The  channel 
alternates  between  these  two  states  and  make  symmetric  transitions.  The  same  two  codes  that  were  men¬ 
tioned  above  serve  both  algorithms.  The  curves  in  Figure  9  show  that  both  algorithms  increase  their 
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throughput  as  the  sojourn  thnft  increases.  However,  the  algorithm  at  the  previous  section,  which  uses 
knowledge  of  the  error  distribution,  achieves  higher  throughput  than  does  the  algorithm  of  the  current  sec- 
tionm  which  does  not  use  such  knowledge. 
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V.  EXTENSIONS 


The  AHARQ  algorithms  we  have  presented  in  Sections  m  and  IV  select  one  of  two  codes  to  use  in  a 
time-varying  channel  with  some  unknown  characteristics.  The  code  selection  is  based  on  a  measure  for 
channel  quality  that  is  updated  by  utilizing  enhanced  feedback  sent  from  the  receiver  to  the  transmitter. 
The  performance  curves  for  these  algorithms  show  that  the  throu^iput  achieved  is  not  very  far  from  that 
achieved  by  an  ideal  observer  has  aD  the  channel  information. 

These  algorithms  can  be  extended  to  the  case  in  which  the  transmitta  holds  K>1  codes.  For  a  set 
of  codes  with  r{>...>rg,  the  transmitter  performs  out  X-1  twt>-oode  algorithms  in  parallel  for 

the  pairs  of  codes  (€2,03),..,  and  selects  the  code  with  the  highest  throughput. 


If  the  k-th  packet  is  transmitted  with  code  C|  and  the  decoding  u  successful  the  receiver  knows  the 
number  of  errors  in  this  packet  and  also  which  of  the  X  codes  could  have  been  used  to  quality  measures, 
or  This  iqxlating  is  more  complicated  when  the  decoding  of  the  packet  fails.  The  receiver 
then  knows  that,  for  all  J,  j<i,  the  code  cj  would  have  also  failed.  However,  there  is  not  much  that  can 
be  said  about  the  possible  success  of  Cj,  j>i.  One  option  is  not  to  update  the  measures  for  the  algorithms 
that  con^Mtre  these  codes.  Another  option  is  to  assume  that,  for  all  j>i,  code  Cj  could  have  decoded  that 
packet  correctly.  Which  of  these  alternatives  is  better  will  depend  on  the  channel  mode. 

The  selection  of  the  best  of  K>2  codes  is  a  little  more  oofiq>lex  than  in  the  case  K^2.  We  propose 
that  the  algorithms  select  the  highest  rate  code,  st^,  Cf  for  winch  the  quality  measure  is  above  the 
threshold  (or  is  above  zero).  The  details  of  this  selection  and  the  performance  evaluation  of 
multiple-code  algorithms  win  be  presented  in  a  forthcoming  papa. 
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Other  extensions,  such  as  operation  over  a  channel  with  a  large  propagation  delay  and  a  noisy  feed- 
badc  channel,  may  also  be  of  interest.  They  win  be  the  subject  to  future  research. 
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APPENIHX:  Eviliiatloo  Of  Tht  Eipccted  Drift  For  q 

In  this  {f>pendix  we  prove  diat,  for  cfaaimd  states  X^,  Xj  die  drift  under  X^  is  positive, 
Eiq(k+i)~q(k)\q(k),l)>Q,  and  under  Xj  £(^(*+l)-fl(*)|9(t),2)<0. 


Proof:  Denote  byq,q^  values  of  q(k+l),  q(k),  respectively.  ^  definition,  when  code  Cf  is  used 


q-q  = 


Pie\K)9 


Pie\\{iq  +  P(e\\^il-q) 
P(e>t,\\,)q 


-q  estf 

- 


(Al) 


Following  some  simple  algebraic  manipulation,  the  drift  can  be  written  as 


^  />(e|X0-i»(e|X3)  />(e>rJX^)-P(e>rJX^ 

i'o/’(elX:)fl+(l-9)F(e|X2)'^^^'^i^  ^  /»(e>t,lXi)9+(l-9)P(e>r,|X2) 


Consider  first  the  denominatar  of  the  term  in  the  summation  in  Eq.  (A2).  Let  be  the  set  of 
values  of  e  such  that  F(e|X^)2F(e|X2)  when  ete^.  Since  0<9<1, 


and 


F(elX2)sF(e|Xi)g+(l-?)F(r|X2)s/»(elXi)  for  ece* 


l^i)  1^1)9  +  (1  ~9)F(e  lX2)sF(e  jXj)  oAerwise; 


Thus,  for  tf  ce^  the  numerator  is  positive;  otherwise  it  is  negative.  Hence,  for  both  cases: 

F(e|Xi)-F(eIX2)  ^  F(e|Xi)-F(e|X2)  . . , 

==  - p/llv  N -  ^  • 


F(e|Xi)9+(l-9)F(elX2) 
Similarly,  for  e>tf 


P(e  >  f,  lXi)fl  +  (1  -  9)F(e  >  rJXj) 

Thus,  for  aD  0<9<1 


P(e>rJXi) 


(A3) 


(A4) 


(AS) 


(A6) 


EW-^M  >  ?(l-^)[2[^('l^)-n^M+/’(^>^,|Xi)--P(«>rJX2)l  =  ^(1-^)0  .  (AT) 

<«o 
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Under  state  X2  the  drift  is  given  by 


^  P(e|X0^/»(e|X2)  f(e>rJX,)-f(e>rJX2) 

.t'on«IM9  +  (l-9)^(«lM  ^  ^  P(*>ri|X09+(l-9)P(e>fJX2)^^'  '>  ^ 


<  9(l-9)[2[^(«IM-^’(«M+^»(«>»<l^i)-^(*>»i|X:)]  =  9(l-9)0  .  (A8) 

*-o 
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